Google's AI trains state-of-the-art language models using less compute and data

Google open-sourced ELECTRA, a language model pre-training technique that achieves state-of-the-art results with less compute on benchmarks like GLUE.